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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )K Responsive to communication(s) filed on 05 March 2003 . 
2a)^ This action is FINAL. 2b)D This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) [3 Claim(s) 1-19 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 1-19 is/are rejected. 

7) 0 Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
1 1 )D The proposed drawing correction filed on is: a)Q approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) D The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)D All b)Q Some * c)D None of: 

1.Q Certified copies of the priority documents have been received. 

2.0 Certified copies of the priority documents have been received in Application No. . 

3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 119(e) (to a provisional application). 
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15) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
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DETAILED ACTION 



Response to Amendment 



1 . This action is in response to the communication filed on March 5, 2003. 

2. Claims 1-19 are pending in this action. 

3. The applicant's arguments with respect to claims 1-19 have been fully 
considered but they are not deemed to be persuasive. For examiner's response to the 
applicant's arguments or comments, see the detailed discussion in the Response to the 
Arguments section. 



4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
(e) The invention was described in - 

(1) an application for patent, published under section 122(b), by another filed in the United States 
before the invention by the applicant for patent, except that an international application filed under 
the treaty defined in section 351(a) shall have the effect under this subsection of a national 
application published under section 122(b) only if the international application designating the 
United States was published under Article 21(2)(a) of such treaty in the English language; or 

(2) a patent granted on an application for patent by another filed in the United States before the 
invention by the applicant for patent, except that a patent shall not be deemed filed in the United 
States for the purposes of this subsection based on the filing of an international application filed 
under the treaty defined in section 351(a). 



5. Claims 6, 7, 13, 14 and 19 are rejected under 35 U.S.C. 102(e) as being 
anticipated by Mozer et al. (US 2002/0091513 A1 , effective filling date December 6, 



As per claim 6 and 19, Mozer teaches, "a method of automatically providing a 
spoken language interface for a user with respect to at least one external network with 



Claim Rejections - 35 USC § 102 



1996). 



which the user interacts, wherein the user process a portable spoken language interface 
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device having a data structure for storing one or more user interface data sets used to 
provide one or more spoken language interfaces," the method comprising the steps of: 

"the device requesting a spoken language interface data set from the external 
network upon discovery of the external network" (Page 3, Paragraph 0032, reads on "at 
step 202, pattern recognition programming system 112 accesses external medium to 
verify it in fact contains recognition set data and weight set data of kind employed by 
pattern recognition system ... at step 204, pattern recognition programming system 
212 retrieves an initial set of words and associated weight set into weight memory 
110"); 

"the external network transferring the spoken language interface data set to the 
device; and loading the spoken language interface data set into the data structure of the 
device for use by the user interfacing with the external network" (Page 3, paragraph 
0032 and 0033, reads on "at step 202, pattern recognition programming system 112 
accesses external medium to verify it in fact contains recognition set data and weight 
set data of kind employed by pattern recognition system ... at step 204, pattern 
recognition programming system 212 retrieves an initial set of words and associated 
weight set into weight memory 1 10 ... the new recognition set and weight sets are 
transferred from external medium to the weight memory through external interface") 

As per claim 7, Mozer teaches, "wherein the device is in wireless 
communications with the external network" (Fig. 1, wireless connection between 
element 118 (external Interface) and 104 (external medium)). 
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As per claim 13, Mozer teaches, "the device prompting the user for information 
comprising a spoken utterance, the device manager being responsive to spoken 
utterance for operatively modifying at least one of the predetermined parameter of the 
device and an application running on the device" (Page 3, paragraph 0029, reads on 
"the information presented to the user may include prompts for input to microphone or 
application specific information" and Paragraph 0033 reads on "pattern recognition 
programming system receives the recognition results and selects a new set of words 
and associated weight set based on this results"). 

As per claim 14, Mozer teaches, "storing one or more user experience 
parameters corresponding to a familiarity of the user with a predetermined procedure of 
the application" (Page 3, paragraph 0029, reads on "the information presented to the 
user may include prompts for input to microphone or application specific information" 
here prompts are based on the application specific information, which is a familiarity of 
the user with a predetermined procedure of the application); 

"selecting a prompts from a set of prompts for presentation to the user, set of 
prompt including varying amounts of instruction based at least in part on experience 
parameters, the selected prompt substantially matching the sorted experienced 
parameters of the user" (Page 3, paragraph 0029, reads on "the information presented 
to the user may include prompts for input to microphone or application specific 
information" here prompts are based on the application specific information). 
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Claim Rejections - 35 USC § 103 



6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 8 and 15-17 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Mozer et al. (US 2002/0091513 A1) as applied to claim 6 above, and further in 
view of Well-known prior art (MPEP 2144.03). 

As per claims 8 and 16, Mozer teaches, all the limitations as stated above in 
claim 6, however, Mozer fails to teach, "a personal data assistant operatively coupled to 
spoken language interface device, PDA including at least one application associate 
therewith". However, Mozer teaches, at Page 2, paragraph 0023, "apparatus may 
provide speech recognition capabilities to for example various electronic appliances 
such as a compact disk changer, telephone, computer, television watch, etc. 
components of apparatus may perform other functions besides speech recognition in 
the context of such appliances. Official Notice is taken on the well-known personal data 
assistant (PDA). It would have been obvious to one of ordinary skill in the art at the time 
of the invention to use a PDA instead a computer or a watch or a telephone, because at 
the time of the invention PDA has equal or more computational power than a personal 
computer. 
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As per claim 17, Mozer teaches, "wherein the portable spoken language interface 
device is a wireless communication with the external network" (Fig. 1, wireless 
connection between element 118 (external Interface) and 104 (external medium)). 

As per claim 15, Mozer teach all limitation as state above in claim 13, however, 
Mozer fails to teach, storing an initial data set including at lest one of a date, time and a 
number of times which a predetermined procedure of an application is performed". 
Official Notice is taken on a well-known process to store a record of date, time and 
number of times, which a predetermined procedure of an application is performed. 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to take a record of date, time and number of times the application being 
performed so that it will be easy for accounting purpose to calculate how many times 
and date and time each application and network being used. 
8. Claims 1-5, 9-12 and 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Mozer et al. (US 2002/0091513) as applied to claims 9 and 16 
above, and further in view of Abella et al. (US 6,044,347). 

As per claim 1 , Mozer teaches, a method for modifying a data structure 
containing at lest one user interface data set, wherein Mozer teaches all the limitations 
as stated above in claim 6. 

Acs per claim 18, Mozer and well-known prior art teaches all the limitation stated 
above in claim 16. 

However as per claims 1 and 18, Mozer and well-known prior art fails to teach, 



Application/Control Number: 09/460,91 3 Page 7 

Art Unit: 2654 

"in apparatus for providing a portable spoken language interface for a user to a 
device in communication with the apparatus, the device having at least one application 
associated therewith, the spoken language interface apparatus comprising:" 

"an audio input system for receiving speech data provided by the user"; 

"an audio output system for outputting speech data to the user"; 

"a speech recognition engine for generating an output in response to spoken 
utterances"; 

"a speech synthesizing engine for generating a synthesized speech output in 
response to text data"; 

"a dialog manager operatively coupled to the device, the audio input system, the 
audio output system, the speech recognition engine and the speech synthesizing 
engine"; and 

"at least one user interface data set operatively coupled to the dialog manager, 
the user interface data set representing spoken language interface elements and data 
recognizable by the application of the device"; wherein: 

(i)"the dialog manager enables connection between the input audio system and 
the speech recognition engine such that the spoken utterance provided by the user is 
provided from the input audio system to the speech recognition engine"; "(ii) the output 
generated by the speech recognition engine is returned to the dialog manager"; "(iii) the 
dialog manager uses the output generated by the speech recognition engine to search 
the user interface data set for a corresponding spoken language interface element and 
data which is returned to the dialog manager when found"; "(iv) the dialog manager 
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provides the spoken language interface element associated data to the application of 
the device for processing in accordance therewith"; "(v) the application of the device, on 
processing that element, provides a reference to an interface element to be spoken"; 
"(vi) the dialog manager enables connection between the audio output system and the 
speech synthesizing engine such that the speech synthesizing engine which, accepting 
data from that element, generates a synthesized output that expresses that element"; 
and "(vii) the audio output system audibly presenting the synthesized output to the 
user". 

However, Abella teaches, above limitations: 

"in apparatus for providing a portable spoken language interface for a user to a 
device in communication with the apparatus, the device having at least one application 
associated therewith, the spoken language interface apparatus comprising:" 

"an audio input system for receiving speech data provided by the user" (col. 4, 
lines 43-44, reads "the system receives a speech signal in the form of utterances from a 
user via a microphone"); 

"an audio output system for outputting speech data to the user" (col. 4, lines 51- 
53, reads "generates an output speech signal by supplying appropriate drive signals to 
a speech synthesizer); 

"a speech recognition engine for generating an output in response to spoken 
utterances" (col. 4, lines 45-57, a speech recognition units); 

"a speech synthesizing engine for generating a synthesized speech output in 
response to text data" (col. 4, lines 45-57, speech synthesizer and col. 5, lines 1-15, 
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here text can be inputted and text can be outputted and inherently by the synthesizer 
speech can be outputted); 

"a dialog manager operatively coupled to the device, the audio input system, the 
audio output system, the speech recognition engine and the speech synthesizing 
engine" (col. 7, line 51, dialog manager); and 

"at least one user interface data set operatively coupled to the dialog manager, 
the user interface data set representing spoken language interface elements and data 
recognizable by the application of the device" (col. 44-56, application is the interface 
data set and reads on "dialog manager is configured to recognize the user request") ; 
wherein: 

(i)"the dialog manager enables connection between the input audio system and 
the speech recognition engine such that the spoken utterance provided by the user is 
provided from the input audio system to the speech recognition engine" (Fig. 2, 
elements 30 and 34); "(ii) the output generated by the speech recognition engine is 
returned to the dialog manager" (Fig. 2, element 40); "(iii) the dialog manager uses the 
output generated by the speech recognition engine to search the user interface data set 
for a corresponding spoken language interface element and data which is returned to 
the dialog manager when found" (Fig. 2, element 42); "(iv) the dialog manager provides 
the spoken language interface element associated data to the application of the device 
for processing in accordance therewith" (Fig. 2, element 42); "(v) the application of the 
device, on processing that element, provides a reference to an interface element to be 
spoken" (Fig. 2, element 42); "(vi) the dialog manager enables connection between the 
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audio output system and the speech synthesizing engine such that the speech 
synthesizing engine which, accepting data from that element, generates a synthesized 
output that expresses that element" (Fig. 2, element 32 and Fig. 1, element 20); and 
"(vii) the audio output system audibly presenting the synthesized output to the user" 
(Fig. 2, element 32 and Fig. 1, element 20). 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to use a device including a duologue manager as taught by Abella, 
in the invention of Mozer because Abella teaches his invention provides an object- 
oriented dialogue manager which allows a computer system or other dialogue 
processing system to conduct an efficient dialog with a human user (col. 2, lines 32-35). 

As per claim 2, Mozer teaches, "the step of audibly notifying the user that the 
new application is useable via the audio output system" (Page 3, paragraph 0029, 
prompts for inputing). 

As per claim 3, Mozer teachers, "further comprising the step of removing a user 
interface data set from the data structure" (Page 3, paragraphs 0032 and 0033, here 
pattern recognition programming system every time retrieve a new data set it reprogram 
the memory with new data set and the old data set is removed) 

As per claim 4, Mozer teaches, "wherein the user interface data set is removed 
prior to the loading step in accordance with a least recently used algorithm." (Page 3, 
paragraphs 0032 and 0033, here pattern recognition programming system every time 
retrieve a new data set it reprogram the memory with new data set and the old data set 
is removed, inherently prior to the loading the new data set). 
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As per claim 5, Mozer teaches, 'wherein the user interface data set is removed in 
accordance with a request by an application" (Page 3, paragraphs 0032 and 0033,, 
because it loaded based on the recognition results, so it is accordance with a request by 
an application). 

As per claim 9, Mozer teaches, "wherein the new application comprises a speech 
aware application, the speech aware application being responsive to user utterances for 
at least partially interacting with the new application" (Page 3, paragraphs 0032, 0033 
and 0034, it can load a new language which is responsive to the old languaguage). 

As per claim 1 0, Mozer does not teach, "the device prompting the user for 
information comprising a spoken utterance, the device manager being responsive to 
spoken utterance for operatively modifying at least one of the predetermined parameter 
of the device and an application running on the device". However, Abella teaches, "the 
device prompting the user for information comprising a spoken utterance, the device 
manager being responsive to spoken utterance for operatively modifying at least one of 
the predetermined parameter of the device and an application running on the device" 
(col. 7, lines 36-67, reads on "in response to particular task, the dialogue manager is 
configured to recognized the user request, . . . supplying user input to the application"). 
Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention to use Abella's teaching because Abella teaches his invention provides an 
object-oriented dialogue manager which allows a computer system or other dialogue 
processing system to conduct an efficient dialog with a human user (col. 2, lines 32-35). 
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As per claim 1 1 , Mozer teaches, "storing one or more user experience 
parameters corresponding to a familiarity of the user with a predetermined procedure of 
the application; selecting a prompts from a set of prompts for presentation to the user, 
set of prompt including varying amounts of instruction based at least in part on 
experience parameters, the selected prompt substantially matching the sorted 
experienced parameters of the user" (Page 3, paragraph 0029, reads on "the 
information presented to the user may include prompts for input to microphone or 
application specific information" and Paragraph 0033 reads on "pattern recognition 
programming system receives the recognition results and selects a new set of words 
and associated weight set based on this results"). 

As per claim 12, Mozer teaches, "storing an internal data set including at lest one of 
date, and time and a number of times which a predetermined procedure of an 
application is performed" (Page 3, paragraph 0029, reads on "the information presented 
to the user may include prompts for input to microphone or application specific 
information" here prompts are based on the application specific information, which is a 
familiarity of the user with a predetermined procedure of the application); and 

"selecting a prompt from a set of prompts for presentation to the user, the set of 
prompt includes varying amounts instruction based at lest in part on information 
included in the internal data set, selected prompt substantially matches the stored initial 
data set" (Page 3, paragraph 0029, reads on "the information presented to the user may 
include prompts for input to microphone or application specific information" here 
prompts are based on the application specific information). 
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Response to Arguments 

9. The applicant asserts that the examiner has failed to provide evidence that the 
parent application serial number 08/882,852 filed on March 24, 1997 supports the 
claims of the Mozer patent publication, and thus fails to show that Mozer is entitle to 
claim the benefit of the earlier filing date for purposes of being used as § 102 (e) prior 
art against the claimed invention. 

The examiner has used the common subject matter, from the application serial 
number 08/822,852, to reject the claims. The examiner has provided a copy of the 
application serial number 08/822,852 as evidence herewith. 

Conclusion 

10. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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Contact Information 



1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Abul K. Azad whose telephone number is (703) 305- 
3838. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha D. Banks-Harold, can be reached at (703) 305-4379. 

Any response to this action should be mailed to: 



Or faxed to: 

(703) 872-9314 

(For informal or draft communications, please label "PROPOSED" or "DRAFT") 
Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal 
Drive, Arlington, VA, Sixth Floor (Receptionist). 

Any inquiry of a general nature or relating to the status of this application should 
be directed to the Technology Center's Customer Service Office whose telephone 
number is (703) 306-0377. 
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